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An N-sguared Algorithm for Optimizing Correlated Events 



TECHNICAL FIELD 

This invention relates generally to the field of integrated circuit 
systems, and more specifically to the detection of defects in digital integrated 
circuits. 

BACKGROUND OF THE INVENTION 

An important aspect of the manufacture of integrated circuits (IC's) is the post- 
production testing process. The goal of the post-production testing process is 
to apply test inputs to a device and determine if the device is defective. 
Preferably, this defect detection process occurs as early point as possible 
since further integration of faulty components rapidly becomes very 
expensive. Consider for example, attempting to determine the location of a 
faulty IC in a personal computer system. There are several different kinds of 
tests that can be applied to IC defect testing. Exhaustive tests seek to apply 
every possible input in order to determine if any defects are present in the IC. 
Functional testing tests the functions present on the IC for correct operation. 
The fault model test determines each type of fault that is likely to occur, and 
devises tests for these common faults. The exhaustive test can be the most 
time-consuming and may also be expensive. Functional testing is problematic 
in that the test design must accurately ensure that all functionality is correctly 
tested. Functionality testing requires application specific knowledge to ensure 
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that all incorporated functionality has been tested. Fault modeling will detect 
the faults assumed within the framework of the fault model. An example of 
the fault model is the stuck-at fault model. This model assumes a limited 
number of faults and assumes that the faults are permanent. 

A well-designed test plan should use the least number of test inputs to cover 
the most number of defects or defective dice (DD's),, and the test plan should 
be designed so that a test sequence is executed in an efficient fashion. Many 
of the exhaustive, functional, and fault models are based upon RTL and 
schematics. Thus the influence of the physical layout of the IC and the 
manufacture process (PLMP) on the defect creation in IC circuits is not 
exploited in the test strategy. The lack of relation between the test input data 
creation and the PLMP makes these methods susceptible to having 
redundant tests and performing a test inefficiently. The number of redundant 
tests and inefficient tests (RIT's) is a valuable parameter to consider when 
designing test plans, since there is a strong benefit in terms of reducing test 
execution time and test complexity when the number of RIT's are reduced. 
Current strategies that reduce the number of RIT's seek to eliminate the 
execution of redundant tests in the IC testing process using the same 
exhaustive, functional, and fault model strategies used in IC standardized IC 
testing. 

Eliminating redundant tests and reordering tests to increase the test efficiency 
has become an important area of research as the IC test becomes 
increasingly expensive. In IC testing, tests are generated using simulations 
and other means. Evaluating the tests is important for increasing test 
efficiency and reducing test time. Efficient numerical algorithms for analyzing 
the test redundancy and the test sequence efficiency are required to meet the 
need for IC test time reduction techniques. 
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3 Thus, there is an unmet need in the art for an efficient numerical algorithm for 

4 analyzing a given test sequence redundancy and efficiency. 
5 

6 
7 

8 SUMMARY OF THE INVENTION 
9 

10 This invention discloses an N 2 algorithm for optimizing IC tests. The 

1 1 test optimization of the present invention refers to minimizing the amount of 

12 time spent on RIT's. The method of the present invention uses the IC 

13 simulation data or IC production test data. The simulation data contains the 

14 relation between tests and defects. The IC production data reflects the PLMP 

15 and gives the relation between tests and DD's. Both of the data can then be 

16 processed to detect RIT's in IC tests. The test optimization can occur on the 

17 defect (fault) level using IC simulation data and the DD level using IC 

18 production data. The optimization process is the same for both defects 

19 (faults) and DD's, so only one approach will be described here. 
20 

21 The test optimization problem may be described as follows: Given N tests in 

22 a test sequence and L DD's, each of the N tests detects between 1 and L of 

23 the L DD's. And each test takes a certain amount of time to be executed. 

24 The first part of the test optimization problem determines the set of tests 

25 which takes the minimum number of tests to detect all the L DD's. The 

26 second part of the test optimization problem determines the set of tests and 

27 the execution sequence of the tests that takes the minimum time to detect all 

28 the DD's. 
29 
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Both test optimization problems can be framed in terms of representing N 
tests as N vectors. Each of the N vectors has L components, corresponding 
to the L DD's. For each of the N tests, we create a correlation vector, V. For 
test i, we have 

V(i) = (vi(i) l v 2 (i) f - > v L (i)), 
where Vj(i) is equal to zero if test i does not detect DD j and is equal to one if 
test i detects DD j. After representing each test as a correlation vector, each 
test can be treated as an event in a correlated event problem. The execution 
time of a test can be treated as the time taken by the corresponding event. 
The list of DD's that a test detects is the correlation vector for the test. 
Therefore, the test optimization problem is the same as the minimum set 
optimization and the minimum time optimization problems of correlated 
events. 

Both parts of the test optimization problem can take on the order of N! 
operations to determine the optimum set. A vector projection technique is 
used to calculate the correlation between the N correlation vectors. This 
projection technique requires on the order of N 2 operations to optimize the 
correlated event problem. 

The following algorithm takes on the order of N 2 operations to determine the 
minimum set in which each test is represented as a correlation vector: 

a. Choose a correlation vector in the N vectors such that the correlation 
vector contains the most number of non-zero components. Assign this 
vector to vector W. Store this vector. 

b. Determine a correlation vector of the remaining correlation vectors such 
that the length of the projection of the multiplication of W and the 
complement of the vector onto the unit vector is the smallest. 

c. Store this vector, and update W to be the multiplication of W and the 
complement of this vector. Repeat the previous step b until the projection 
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I of W onto the unit vector becomes zero. 
2 

3 The following algorithm takes on the order of N 2 operations to determine the 

4 minimum time: 
5 

6 Represent each test as a correlation vector. 

7 a. Choose a correlation vector in the N vectors such that the vector has the 

8 largest value of the number of non-zero components divided by the time 

9 associated with the vector. Multiply the complement of this vector with the 
O 1 0 unit vector and form a vector W. Store this vector. 

I I b. Determine a correlation vector of the remaining correlation vectors such 

12 that the length of the projection of the vector onto vector W divided by the 

1 3 time associated with the vector is the largest. 

14 c. Store this vector, and update W to be the multiplication of W and the 

15 complement of this vector. Repeat the previous step b until the projection 

1 6 of vector W onto the unit vector becomes zero. 



m 17 

O 18 



19 BRIEF DESCRIPTION OF THE DRAWINGS 

20 

21 The features of the invention believed to be novel are set forth with 

22 particularity in the appended claims. The invention itself however, both as to 

23 organization and method of operation, together with objects and advantages 

24 thereof, may be best understood by reference to the following detailed 

25 description of the invention, which describes certain exemplary embodiments 

26 of the invention, taken in conjunction with the accompanying drawings in 

27 which: 
28 

29 
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1 FIG. 1 is a block diagram of a minimum set optimization method, 

2 according to an embodiment of the present invention. 
3 

4 FIG. 2 is a block diagram of a minimum time optimization method, 

5 according to an embodiment of the present invention. 
6 

7 

8 DETAILED DESCRIPTION OF THE INVENTION 
9 

10 While this invention is susceptible of embodiment in many different forms, 

1 1 there is shown in the drawings and will herein be described in detail specific 

12 embodiments, with the understanding that the present disclosure is to be 

13 considered as an example of the principles of the invention and not intended 

14 to limit the invention to the specific embodiments shown and described. In the 

15 description below, like reference numerals are used to describe the same, 

16 similar or corresponding parts in the several views of the drawings. 
17 

18 The disclosed algorithm for optimizing correlated events is applied to the 

19 problem of analyzing redundant tests and reordering tests. Thus, as will be 

20 shown below, the problem of analyzing redundant tests and reordering tests is 

21 equivalent to analyzing correlated events. The description of this invention 

22 contains three parts: The formulation for correlated events, the algorithm for 

23 optimizing the correlated event problem, and the mapping between the 

24 correlated event optimization problem and the related test optimization 

25 problem. 
26 

27 Correlated Events 

28 Consider N events that may occur in any sequence. Number the N events 

29 using integers from 1 to N. If the N events are correlated, the occurrence of 
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1 some of the events depends on the occurrence of other events. For example, 

2 consider N = 5. The correlation among the five events may be the following: 
3 

4 1 ) If events 2, 4 and 5 take place before events 1 and 3, then events 1 and 3 

5 will not occur. 

6 2) If events 1 and 5 take place before events 2, 3 and 5, then events 2, 3, 

7 and 5 will not occur. 

8 Conditions 1 ) and 2) define the correlation among the five events in this 

9 example. 
10 

1 1 In the N correlated events, there is at least one such set of events that their 

12 occurrence prevents other events from occurring. In general, there exists 

1 3 more than one such set of events. Such a set of events is called a minimum 

14 set. The problem of finding the minimum set of events is referred to as a 

15 minimum set optimization problem. In the above example, events 1 and 5, 

16 are the minimum set. Finding the minimum set of a collection of events is 

17 difficult in general because the correlation among events is defined implicitly 

18 and the value of N is often large. Therefore, the complexity of the 

1 9 computation for finding a minimum set is very high. 
20 

21 To formulate the correlation among N events, we represent each of the N 

22 events as a binary vector in an L-dimensional correlation space. Each of the 

23 components of a binary vector is (0,1) valued. The binary vectors are called 

24 correlation vectors. Let V(i) be the correlation vector associated with event i. 

25 Then, 

26 V(i) = (vi(i), v 2 (i) v L (i)) 

27 where Vj(i) is the jth component of correlation vector V(i) and is (0,1)-valued. 

28 To describe the correlation among the N events, we need to define the 

29 operations of the multiplication, addition, and complement of correlation 
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1 vectors. Define multiplication of correlation vectors V(i) and V(j) to be 

2 V(i)V(j) = (vi(i)& vi(l) f v 2 (i)& v 2 (i),..., v L (i)& v L (i)), 

3 where & is the Boolean AND operator. Define the addition of correlation 

4 vectors V(i) and V(j) to be 

5 V(i)+V(j) = ( Vl (i)| Vl (i), v 2 (i)|v 2 (i),..., v L (i)|v L (i)), 

6 where | is the Boolean OR operator. Finally, define the complementary vector 

7 of correlation vector V(i), V(i) to be the complement of the individual 

8 components. 
9 

10 Let I be the unit correlation vector. All the components of the unit correlation 

1 1 vector are one. The correlation among the N events is defined to be that the 

12 occurrence of events ii, i 2 , ... , i a prevents the occurrence of events i a +i, ... , L 

13 lf£K(i,) = I, (1) 

7=1 

14 where 1<=a<=L,K=l j <=N ) ij != i k and 1<=j, k<=L This equation can also be 

1 5 written as 



16 YlVii^F (2) 

rij 

17 

18 The correlation vectors determine the correlation among the N events through 

19 equation (1) or equation (2). The minimum set optimization is to find a set of 

20 events so that the value of the variable a in equation (1) or equation (2) 

21 reaches it's minimum. 
22 

23 

24 In a more general case, each event is associated with a time. Let t(i) be the 

25 time that event i takes. Then the total time T that events h, i 2f . . . , i a take is 

26 T(i 1f i 2 , ... ,i a )= 2>7,) (3) 
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1 The minimum time optimization problem is to find a set of events so that the 

2 total time T reaches it's minimum. This problem is called minimum time 

3 optimization. If all the t(i)'s are equal, then this problem reduces to the 

4 minimum set optimization problem. 
5 

6 From the formulation of correlated events above, we can see that the values 

7 of N and L determine the complexity of the correlation. In practice, the values 

8 of N and L are large, so that the optimization problem can be intractable. 
9 

10 
11 

12 Minimum Set Optimization Problem 
13 

14 If an exhaustive search is performed, the computation across N events 

15 requires O(NI) operations, so that this method is not practical for large values 

16 of N. The following minimum set optimization algorithm is 0(N 2 ). 
17 

18 Define P A (B) to be the square of the length of the projection of correlation 

1 9 vector B onto correlation vector A. So 

20 P A (B)=£a,.Z> 

i=i 

21 

22 Define W(i 1 , i 2 , ... , i k ) to be 

23 W(ii,i 2 , ... ,i k ) = l flViiJ. 

7=1 

24 

25 With this definition, Pi(W(h, i 2 , ... , i a )) = Pi(0=0. By definition, for a given W, 

26 Pi(W) >=0 and is a decreasing function of k in W. That is, adding a correlation 

27 vector to W decreases Pj(W) . In the process of searching a minimum set, if 
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1 we keep the value of P|(W) to be as small as possible while adding correlation 

2 vectors to W, then the set of events in W will approach a minimum set. 

3 Assume that a set of correlation vectors V(i 1 ), V(i 2 ),..., V(i k )) in the N vectors is 

4 chosen such that P|(W) is a minimum. As we add additional vectors to W 

5 from the remaining N-k vectors while we keep P|(W) to the minimum, we will 

6 eventually reach Pi(W) = 0. This set of vectors in W will represent the 

7 minimum set. Referring to FIG. 1, and the following pseudo-code, the 

8 minimum time optimization algorithm is summarized: 
9 

10 U(i) = minimum set; W = I; n = 1 ; // block 1 1 0 

11 for(l=1;K=N;l++) 



12 { 

13 M 0 = Land i 0 = 1 //block 120 

14 for 0=i;j<=N;j++) 

15 { 

16 //start block 130 

17 M = Pi(W*V(j)'); 

18 if(M<=M 0 ) 

19 { 

20 Mo = M; 

21 io = j; 

22 } 

23 //end block 130 

24 } 

25 //start block 140 

26 U(n) = V(i 0 ); 

27 if (Mo == 0) 

28 stop; 

29 //end block 140 
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//start block 150 
W = WU(n)'; 
n=n+1; 

//end block 150 
} 



Minimum Time Optimization 



In this problem, it is necessary to include the changes to Pi(W) and the 
changes to time T by t(l k +1) when we add the (k+1)th correlation vector into 
W. First note that, 

P A (B) = P B (A) (4) 
and 

P A (I) = P A (B + B') = P A (B) + Pa(B') (5) 

Using equations (4) and (5), one can readily obtain 

P w ( ii,i2,... ,ik> (V(ik +1 )) = -[Pi (W(ii, i 2 , , i k+ i)) - Pi (W(h, i 2 ik))]. 

From this equation, it is seen that P w <h, a,.., ik) (V(i k+ i)) is an amount of the 
decrement of P,(W) after adding a (k+1)th correlation vector into W. It is 
possible to treat the value of P wot a, .. , ik) (V(i k+ i)) as a measure of a 
displacement of Pi(W) towards 0 after time t(i k+ i) is taken by event (i k+ i). 

Then, the quantity P w <m, a ik) (V(i k+ 0) / t(i k+ i) is the measure of the speed 

of Pi(W) towards 0 when event vector V(i k+ i) is added into W. If we choose 
the (k+1)th event such that the value of P w(M, i2, ... , ik) (V(i k+ i)) / t(i k+ i) is a 
maximum, then this selection causes the total time T to be a minimum, 
T(ii,i 2 ,...,ia). Referring to FIG. 2, and the following pseudo-code, the minimum 
time optimization algorithm is summarized: 
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1 

2 U(i) = the minimum set of correlated events, W = I, and n = 1 // block 21 0 

3 for(i=1;i<=N;i++) 

4 { 

5 Mo = 0; // block 220 

6 for (j=i;j<=N;j++) 

7 { 

8 // start block 230 
y. 9 M = Pw(V0))/t(j); 

0 10 if(M>=M 0 ) 

Sj 12 M 0 = M; 

j 13 i 0 =j; 

=P 14 } 

a 15 // end block 230 

tl 16 } 

01 17 // start block 240 

| 18 U(n) = V(i 0 ); 

19 if(M 0 ==0) 

20 stop; 

21 // end block 240 

22 W = WU(n)'; n=n+1;// block 250 

23 } 
24 

25 The minimum time algorithm and the minimum set algorithm contain two loops 

26 related to the number of events, N. The number of operations is proportional 

27 to N 2 which is much smaller than O(NI). Also, note that bit maps can be used 

28 to store the correlation vectors so that less memory is used and bit-wise 

29 operations are used to calculate W. The use of bit maps and bit-wise 
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operations also reduce the amount of time required to execute the algorithms. 

When the execution time of each test is the same, the minimum set 
optimization algorithm can be applied to the determination of how to remove 
redundant tests and reorder tests in an efficient sequence such that higher 
efficient tests are executed earlier. When the execution time of each test is 
different, the minimum time optimization algorithm can be applied to the 
determination of how to remove redundant tests and the efficient test 
execution sequence. If we associate N with the number of tests in a given test 
sequence, and L with the number of DD's, then we can represent the N tests 
as L-dimensional correlation vectors. With this assignment, it becomes 
possible to apply the minimum set optimization and minimum time 
optimization to RIT's. 

While the minimum time optimization and the minimum set optimization have 
been applied to the RITs, it will be clear to one of skill in the art that the 
minimum time optimization and minimum set optimization may be applied to 
other optimization problems. Examples of other optimization problems 
include determining DD. 

While the invention has been described in conjunction with specific 
embodiments, it is evident that many alternatives, modifications, permutations 
and variations will become apparent to those of ordinary skill in the art in light 
of the foregoing description. Accordingly, it is intended that the present 
invention embrace all such alternatives, modifications and variations as fall 
within the scope of the appended claims. 

What is claimed is: 
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